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VIDEO ENCODING APPARATUS, VIDEO ENCODING METHOD, 
AND FRAME RATE CONVERSION APPARATUS 

FIE LD OF THE INVENT ION. 

The present invention relates to a video encoding apparatus 
and a video encoding method and, more particularly, to those for 
correcting a deviation of a vertical sync signal, when data 
supplied from the outside are compressed and recorded within a 
limited period of time. 
H BACKGROUND OF THE TNVF.NTTON 

O 

O MPEG2 (ISO/IEC 13818-2) is known as an international 

$ 

ifU standard of video compression. In video compression methods such 
fU as MPEG2, in order to increase the compression efficiency by 
* bidirectional prediction, the order of input pictures should be 
jJ changed (reordering) when encoding the pictures. 

fj When an input NTSC signal is MPEG-encoded in real time, the 

W NTSC signal is initially converted into a digital signal, e.g., a 
Dl format which is a video component of a non-compressed and 
CCIR-601 convertible digital format, and the digital signal is 
encoded. At this time, the signal may fluctuate or the temporal 
input may deviate when using an asynchronous clock, resulting in 
a phenomenon in which decoded pictures are disordered. 

In order to solve this problem, a process of correcting a 
deviation of a sync signal when inputting an analog signal, which 
process is generally called "time base correct (TBC) 11 , is 
required in the stage prior to an encoder. 
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However, as digital processing has become widespread, it is 
more important to suppress a deviation of a frame cycle due to 
_asynchronicity of a clock than to su p press a signal fl uctuatio n. 

As a technique for correcting a deviation of a vertical sync 
signal, for example, Japanese Published Patent Application No. 
Hei . 11-2 61968 discloses a video compression recording apparatus 
with an external input function, which is provided with a means 
for judging a vertical sync interval of an external input signal. 
In this apparatus, when the external input signal is changed by a 
switcher or the like and it is judged that the vertical sync 
interval of the external input signal is shorter than a normal 
vertical sync interval, a process of thinning the short-interval 
vertical sync signal is carried out. On the other hand, when it 
is judged that the vertical sync interval of the external input 
signal is longer than the normal vertical sync interval, capture 
of the external input signal is stopped for a period of time that 
is equivalent to the increase in the vertical sync interval. 
Thereby, occurrence of an incorrect stream is prevented. 

Although the conventional video encoding apparatus is 
constructed as described above to prevent occurrence of an 
incorrect stream, since capture of the external signal is stopped 
when the vertical sync interval becomes longer than the normal 
interval, data are not supplied to the encoder during this period 
of time. 

Furthermore, a buffer memory for temporarily holding data to 
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be inputted to the encoder, having a capacity equivalent to one 
frame, is usually provided in the stage prior to the encoder . 

H owever , when a pro cess of correcting a de v iati on of a frame _ 

cycle is to be carried out in the stage prior to the encoder, an 
additional memory for this process is required, which leads to an 
increase in device size, or another circuit should be added, 
resulting in an increase in costs. 
SUMMAY OF THE TNVF.NTTON 
I* The present invention is made to solve the above-described 

s 

P problems and has for its object to provide a video encoding 

ilJ apparatus (MPEG encoder) which can correct a deviation of a 

^ vertical sync signal, without adding an extra memory, with 

in 

suppressing an increase in circuit scale, by giving an attention 
|J to a memory for picture reordering, which is possessed by an 

y 

J2 encoder such as an MPEG encoder, and successfully utilizing the 

U 

reordering function of the memory. 

It is another object of the present invention to provide a 
frame rate conversion apparatus which performs encoding at an 
arbitrary frame rate, on the basis of an externally inputted 
signal . 

Other objects and advantages of the invention will become 
apparent from the detailed description that follows. The 
detailed description and specific embodiments described are 
provided only for illustration since various additions and 
modifications within the scope of the invention will be apparent 
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to those of skill in the art from the detailed description. 

According to a first aspect of the present invention, a 

video encodi ng appa ratus comprises: a picture memory for holding 

inputted pictures; a reference time generation means for 
generating time information to be a reference; a picture input 
means for writing an inputted picture into a designated position 
in the picture memory; an input time recording means for 
recording a time that is outputted from the reference time 

I* generation means when a picture is inputted to the picture input 

P 

O means, and a position in the picture memory where the inputted 

ili picture is written, such that the time is associated with the 

fU position; an encoding means for encoding data in a designated 

s position in the picture memory; and a picture memory designation 

W means for designating positions in the picture memory which are 

M targeted for processing, and indicating the positions to the 

O 

Til picture input means and the encoding means, respectively, on the 
basis of the information recorded by the input time recording 
means. In this video encoding apparatus, when an input picture 
is written in the picture memory, a reference time and a position 
in the picture memory where the input picture is written are 
stored in association with each other, and pictures are written 
in an available area in the picture memory. Therefore, 
occurrence of an incorrect stream can be easily prevented by 
performing encoding on the basis of the time information. 
Further, since picture data can be stored in a picture memory for 
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reordering which has conventionally been employed, the device 
size is not increased, and there is no necessity of adding 
ano ther ci rcuit, r e sulting in no increase in costs. 

According to a second aspect of the present invention, in 
the video encoding apparatus according to the first aspect, when 
the picture memory designation means designates a position in the 
picture memory for the encoding means, the picture memory 
designation means designates a position corresponding to a time 
M which is closest to an ideal input time of data to be encoded. 

g 

P According to a third aspect of the present invention, in the 

Hi video encoding apparatus according to the first aspect, when the 
j| picture memory designation means designates a position in the 

picture memory for the picture input means, if data in the 
*Jr; picture memory has not yet been encoded, the picture memory 

designation means stops data input until a writable memory area 
''• J is secured. 

According to a fourth aspect of the present invention, in 
the video encoding apparatus according to the first aspect, when 
the picture memory designation means designates a position in the 
picture memory for the picture input means, if data in the 
picture memory has not yet been encoded, the picture memory 
designation means designates a position corresponding to the 
latest time. 

According to a fifth aspect of the present invention, a 
video encoding method employing a picture memory for performing 
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reordering of pictures for predictive coding, comprises the steps 
of: a picture inputting step of writing an inputted picture into 

_ a d esignated position in the pictur e memory ; an input time 

recording step of recording a time at which the picture is 
inputted, and the position in the picture memory where the 
inputted picture is written, such that the time is associated 
with the position; a picture memory designation step of 
designating positions in the picture memory which are targeted 
H for processing in the picture inputting step and an encoding step, 

o 

C3 respectively, on the basis of the information recorded in the 

'fi. 

input time recording step; and an encoding step of encoding data 

% 4 

in a designated address in the picture memory. In this video 
encoding method, when an input picture is written in the picture 
JJf memory, a reference time and a position in the picture memory 
jf where the input picture is written are stored in association with 
each other, and pictures are written in an available area in the 
picture memory. Therefore, occurrence of an incorrect stream can 
be easily prevented by performing encoding on the basis of the 
time information. Further, since picture data can be stored in a 
picture memory for reordering which has conventionally been 
employed, the device size is not increased, and there is no 
necessity of adding another circuit, resulting in no increase in 
costs . 

According to a sixth aspect of the present invention, in the 
video encoding method according to the fifth aspect, the picture 
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memory designation step includes a step of designating a position 
in the picture memory, which position is closest to an ideal 
inp ut t ime _p f dat a to be encoded, w hen des ign atin g _a_ pos iti on in 
the picture memory in the encoding step. 

According to a seventh aspect of the present invention, in 
the video encoding method according to the fifth aspect, the 
picture memory designation step includes a step of stopping data 
input until a writable memory area is secured, if data in the 
picture memory has not yet been encoded when designating a 
position in the picture memory in the picture inputting step. 

According to an eighth aspect of the present invention, in 
the video encoding method according to the fifth aspect, the 
picture memory designation step includes a step of designating a 
position in the picture memory, which position corresponds to the 
latest time, if data in the picture memory has not yet been 
encoded when designating a position in the picture memory in the 
picture inputting step. 

According to a ninth aspect of the present invention, a 
frame rate conversion apparatus comprises: plural frame memories 
for holding inputted pictures; a reference time generation means 
for generating time information to be a reference; a picture 
input means for writing an inputted picture into a designated 
address in a frame memory; an input time recording means for 
recording a time which is outputted from the reference time 
generation means when a picture is inputted to the picture input 



means, and an address in the frame memory where the inputted 
picture is written; an encoding cycle setting means for 

out p utti n g an encoding ey e le setting signa l which design ates an 

encoding cycle; an encoding means for encoding data in a 
designated address in the frame memory; and a picture memory 
designation means for designating addresses in the frame memory 
which are targeted for processing, for the picture input means 
and the encoding means, respectively, on the basis of the 

I* information recorded by the input time recording means, and the 

!? 

O encoding cycle setting signal outputted from the encoding cycle 
setting means. In this apparatus, picture data before being 
encoded and input time information thereof are temporarily stored 
in a frame memory for reordering, and the picture data stored in 
the frame memory is successively encoded according to an encode 
cycle setting signal that is supplied from the outside. 
Therefore, it is possible to encode a bit stream of a frame cycle 
that is completely different from an input frame cycle. 
BRIEF DESCRIPTIO N O F THE DBA WING s^ 

Figure 1 is a block diagram illustrating the construction of 
an MPEG encoder which is a video encoding apparatus according to 
a first embodiment of the present invention. 

Figure 2 is a block diagram illustrating the construction of 
a controller which is a component of the MPEG encoder. 

Figure 3 is a flowchart illustrating the operation of the 
controller when a frame sync signal is inputted to the controller. 
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Figure 4 is a flowchart illustrating the operation of the 
controller which specifies an encode frame number, according to 
the first embodiment. 



Figure 5 is a timing chart illustrating the condition of use 
of a frame memory for input frames, in the MPEG encoder according 
to the first embodiment. 

Figure 6 is a block diagram illustrating the construction of 
a video encoding apparatus according to a second embodiment of 
= 4 the present invention. 

Figure 7 is a flowchart illustrating the operation of a 
fl"j controller which is a component of the video encoding apparatus 
fjl of the second embodiment, when a frame sync signal is inputted to 

m 

s the controller. 

ijt Figure 8 is a timing chart illustrating the condition of use 

?J of a frame memory for input frames, in the video encoding 
fjj apparatus according to the second embodiment. 

Figure 9 is a block diagram illustrating the construction of 
a frame rate conversion apparatus according to a third embodiment 
of the present invention. 

Figure 10 is a block diagram illustrating the construction 
of a controller which is a component of the frame rate conversion 
apparatus . 

Figure 11 is a timing chart when encoding is carried out 
with half the cycle of an input frame, in the frame rate 
conversion apparatus. 



DETAILED DESCRIPTION OF THF. PREFERRED FMBOD TMF.NT S 

Hereinafter, preferred embodiments of the present invention 

w ill b e described with refer en ce t o t he dr awings. 

[Embodiment 1] 

Figure 1 is a block diagram illustrating the construction of 
a video encoding apparatus according to a first embodiment of the 
invention, which is adapted to an MPEG encoder. 

With reference to figure 1, an MPEG encoder according to the 
lA first embodiment comprises a video input interface 103 to which 
p an input picture 101 and an input clock 102 are supplied; a 
Fil reference time generator 104 for generating a reference time; an 
f|J encoding unit 106 for encoding the input picture and outputting a 

in 

* bit stream 108; a controller 105 for controlling the operations 
W of the video input interface 103 and the encoding unit 106, on 

a 

tQ receipt of the reference time and a frame sync signal 111; and a 

Q 

ftf memory 107 for reordering (hereinafter referred to as a 
reordering memory) . 

To be specific, the reordering memory 107 is a memory for 
picture reordering, which is adapted to bidirectional prediction 
specific to MPEG. The reordering memory 107 is composed of 
plural frame memories, and each frame memory is designated by a 
frame memory number. In MPEG encoding, pictures are classified 
into three types: I pictures, P pictures, and B pictures. 
Especially, a B picture is formed by bidirectional prediction 
from a previous reference picture (a picture in the past) and a 
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subsequent reference picture (a picture in the future) , and 
therefore, a picture that is subsequent to the B picture (a 
picture in the future) must be encoded be for e the B pic tur e. 
This processing is called "reordering". 

The minimum capacity of the reordering memory required for 
encoding is usually decided depending on a frame interval between 
reference frames. Usually, this frame interval is referred to as 
"M" . It is premised that four frames are used in this first 
embodiment . 

g>3 The video input interface 103 (video input means) writes the 

fjl input picture 101 into a frame memory (107) which is designated 
by a write frame number 112, when a video input enable signal 113 

m 

■ s from the controller 105 is "1". Further, the video input 

O 

y interface 103 generates a frame sync signal 111 on the basis of 
ffj the input picture 101. On the other hand, when the video input 

o 

fy enable signal is "0", no data is written in the frame memory. 

However, a frame sync signal 111 is generated even in this case. 

The reference time generator 104 generates a time to be a 
reference time, and time information 110 generated by the 
reference time generator 104 is transmitted to the controller 105 
(frame memory designation means) . The reference time generator 
104 is not required to be synchronized with the input clock 102. 

The encoding unit 106 (encoding means) encodes picture data 
designated by an encode frame number in the reordering memory 107, 
and outputs it as a bit stream 108. Of course, this encoding is 
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carried out in encoding order, and the encoding order will be 
later described in more detail. 
The MPEG encoder shown in figu re 1 is simi lar to the 



conventional MPEG encoder except that the reference time 
generator 104 is newly provided, and its circuit scale is almost 
equal to that of the conventional one. 

Hereinafter, a description will be given of a general data 
flow of the MPEG encoder. 

The input picture 101 synchronized with the input clock 102 
p is inputted to the video input interface 103. This video input 
ffj interface 103 stores the input picture in a designated frame in 

rS the reordering memory 107, according to an instruction of the 

iff 

s controller 105. 

P 

Uf The stored input pictures are encoded by the encoding unit 

M 106 according to the encoding order, and outputted as a bit 

o 

rtl stream 108. 

The controller 105 reads the time information 110 when the 
frame sync signal 111 is generated, and records it. The 
controller 105 controls the video input interface 103 and the 
encoding unit 106 according to the time information 110. A 
specific control method will be described later. 

Figure 2 shows the construction of the controller 105 in 
detail. The controller 105 includes frame memory control 
memories as many as the frame memories. Since four frame 
memories are employed in this first embodiment, four memory areas 
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are prepared. The respective areas can hold input time 
information 220~223, respectively. Further, the controller 105 
ho 1 ds reference picture time information 21 1 indicating an inp ut _ 
time of I or P picture which have just previously encoded, and 
threshold time information 210 indicating a time at which data in 
an already-encoded frame memory was encoded. As described above, 
since the process of reordering is carried out in MPEG encoding, 
even when a picture has been encoded, a picture at a time 

H previous to this encoded picture is not always unnecessary. 

tj 

O Further, since the purpose is frame synchronization, there is a 

V3 

W possibility that a picture which has already been encoded might 

yi 

jfU be subjected to encoding and, therefore, already encoded data is 

in 

not always unnecessary. 
W So, after a B picture has been encoded, all of data to be 

52 encoded thereafter have times after the time of the B picture. 
^ After an I or P picture has been encoded, data to be encoded 

before the I or P picture has a time after a time of an I or P 
picture which has previously been encoded. The reason is as 
follows. Even if a B picture is encoded thereafter, forward 
reference time information of the B picture matches the encode 
time of the I or P picture which has previously encoded. 
Accordingly, the controller 105 holds the two kinds of time 
information, i.e., the threshold time information and the 
reference picture time information, to find erasable candidates 
from the frame memories. Therefore, in order to find erasable 



candidates from the frame memories, pictures in the past with 
respect to the threshold time information are regarded as 

erasable data, and the r eferen ce picture time in forma tio n 

indicates a time of an I or P picture which has been encoded most 
recently or which will be encoded just now, and this time is used 
for calculating the threshold time information. The initial 
values of the reference picture time information 210 and the 
threshold time information 211 take negative times. 

% B i An encode time generator 202 generates an ideal input time 

P 

p of a frame to be encoded. The operation of the encode time 

fjj generator 202 will be described later. 

Fjj A control unit 203 receives the frame sync signal 111 and a 

m 

s signal from the encode time generator 202, and generates various 
|tl kinds of control signals. The operation flow of the control unit 

a 

CO 203 is shown in figures 3 and 4. 

o 

fit Figure 3 is a flowchart illustrating the operation of the 

control unit 203 when the frame sync signal is generated. 

The control unit 203 captures the time information 110 in 
STEP 301, and proceeds to STEP 302. 

In STEP 302, it is judged whether any of the input time 
information 220~223 is smaller than the threshold time 
information 210 or not. When none of the input time information 
220~223 is smaller than the threshold time information 210, the 
control unit 203 goes to STEP 303. Otherwise, it goes to STEP 
304. In this judgement process, it is found whether there is any 
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I, P, or B picture which has already been encoded and will not be 
used any more, among the data stored in the reordering memory 107 

comprising the frame memories. 

When any of the input time information 220~223 is smaller 
than the threshold time information 210, the control unit 203 
goes to STEP 304, and outputs a frame memory number corresponding 
to the input time information smaller than the threshold time 
information 210 as a write frame number 112, and then goes to 
STEP 307 which will be described later. 
(3 On the other hand, when it is judged in STEP 302 that none 

FU of the input time information 220~223 is smaller than the 
fU threshold time information 210, the control unit 203 goes to STEP 

in 

2 303, and judges whether any of the input time information 220~ 

W 223 matches the reference picture time information 211 or not. 

(3 

M When none of the input time information 220~223 matches the 

q 

fll reference picture time information 211, it means that no empty 

frame memory exists. Then, the control unit 203 goes to STEP 305, 
and searches for data having the latest time. On the other hand, 
when it is judged in STEP 303 that any of the input time 
information 220~223 matches the reference picture time 
information 211, the control unit 203 goes to STEP 306, and 
judges whether the frame corresponding to the input time 
information matches the encode frame or not. When the frame 
matches the encode frame, this frame cannot be used because it is 
being encoded. So, the control unit 203 returns to STEP 305, and 



searches for data having the latest time. 

On the other hand, when it is judged in STEP 30 6 that the 

frame d oes not mat ch the encode _fr ame, it means that a writab le 

frame memory exists. So, the control unit 2 03 outputs the frame 
memory number corresponding to the input time information (any of 
the input time information 220~223) that matches the reference 
picture time information 211, as a write frame number 112. 

In STEP 305, as no writable empty frame exists, the control 
I* unit 2 03 searches the frame memories for data having the latest 

9 

O time, and designates the frame number of this data as a writable 

%9 

Ft! frame number. This data reordering process enables data at a 

*4 

fjJ time when the input timing returns to its normal state to be 
^ decoded without being skipped. 

STEP 307 to STEP 310 are process steps for checking as to 

whether data can certainly be written in the outputted write 
W frame number, i.e., the frame number into which the data will be 

written. 

More specifically, in STEP 307, it is judged whether the 
write frame number 112 which is outputted in STEP 3 04, 3 05, or 
311 matches the encode frame number 114 or not. When the write 
frame number 112 does not match the encode frame number 114, it 
means that data can be written in this frame number. So, the 
control unit 203 goes to STEP 308, and sets the video input 
enable signal 113 in its enable state, whereby writing of data 
into the memory 107 is enabled actually. In STEP 310, the time 
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information captured in STEP 301 is written in the area (any of 
the input time information 220~223) corresponding to the write 
frame numbe r 2 0 6, thereby c ompleting the pr oc essing . 



On the other hand, when it is judged in STEP 307 that the 
write frame number 112 matches the encode frame number 114, 
writing of data into this frame might cause destruction of data 
being encoded, the control unit 203 proceeds to STEP 309, and 
sets the video input enable signal 113 in its disable state to 
complete the processing. Although it is rare in usual processing 
that the result of judgement in STEP 307 is absence of writable 
area, such situation might occur when the encode time becomes 
longer than necessary for any reason. 

Figure 4 shows a process flow of the control unit 2 03 on the 
basis of the information generated by the encode time generator 
202. 

In STEP 401, the control unit 203 selects input time 
information closest to the encode time information 230 from among 
the input time information 220~223 except for one corresponding 
to the write frame number 2 0 6, and outputs the frame number 
corresponding to the selected time information as an encode frame 
number 114, and then goes to STEP 402. 

In STEP 4 02, it is judged whether picture type information 
is "B" or not. When it is "B", the control unit 203 goes to STEP 
403. Otherwise, the control unit 203 goes to STEP 404. 

In STEP 403, any of the input time information 220~223 
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which corresponds to the encode frame number 114 is written as 
the threshold time information 210, thereby completing the 

processing. 

In STEP 404, the data of the reference picture time 
information 211 is written as the threshold time information 210. 
Then, in STEP 405, any of the input time information 220~223 
which corresponds to the encode frame number 114 is written as 
the reference picture time information 211, thereby completing 

r pi the processing. 

g 

O As described above, in order to find an empty frame memory, 

data of a time earlier than the threshold time information (refer 
fjf to STEP 3 02) is searched for, and when the corresponding data 
:^ exists, this data can be erased (overwritten) . When there is no 
% data earlier than the threshold time information, a frame memory 
12 having the same information as the reference picture time 
l ~ information is searched for (refer to STEP 303), and it is 

checked whether the frame memory is currently being encoded (STEP 
306) . When the frame memory is not being encoded, the frame 
memory is treated as an erasable (over-writable) frame memory, 
whereby the process of correcting a frame cycle deviation can be 
carried out using the reordering memory 107 without adversely 
affecting the encoding process. 

Figure 5 is a timing chart illustrating the use condition of 
the frame memory corresponding to the input frame according to 
the above-mentioned control . 
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The first stage in figure 5 shows the picture input timing. 
To simplify the description, a period for vertical 

s ynchroni za tion or the like is not parti cularly shown. F urthe r, 

an input period of normal one frame is "1". 

With reference to figure 5, the input time of frame "5" is 
delayed to be 1.5 frame, and the following frame "6" is started 
not from its original time "6" but from time "6.5", and the frame 
input returns to the normal state at time "7". 

f A The second stage in figure 5 shows the encode time 

S 

O information 230 (the order along which pictures are encoded) and 



the picture type information 231 (I, P, B) which are generated by 
the encode time generator 202. 

The decoding result 505 at the lowermost stage in figure 5 
shows data to be outputted as the result of decoding the 
generated codes . 

As shown in figure 5, as encoding is carried out according 
to the flow of the controller 105, when section (a) is normal, 
the frame inputted at time "5" should be encoded. However, since 
the input has not yet ended at time "5", the picture which has 
been inputted at time "4" is being encoded. 

Further, at section (b) , the input at time "8" is written 
over the picture of time "7" which has not yet been encoded. 
Accordingly, the picture of time "7" is consequently skipped 
without being encoded. 

As can be seen from figure 5, in the decoding result, the 
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picture of time "3" freezes and the pictures of times ^5" and "1" 
are skipped. As a whole, however, input pictures are 

satisfactorily decoded without a failure in decoding. 

As described above, according to the first embodiment of the 
invention, the video encoding apparatus is provided with the 
reference time generator 104 for generating a reference time, and 
the input picture data before being encoded and the time 
information generated by the reference time generator 104 are 

|a temporarily stored in the frame memories 107 for reordering, and 

9 

O the picture data stored in each frame memory is encoded according 

jfU to the time information which is recorded simultaneously with the 

I'U picture data. Therefore, even when vertical synchronization 

m 

^ deviates, the picture data can be successively encoded according 
W to the time information, whereby the disordered input pictures 
1=8 can be encoded with less sense of abnormality. 

Further, since the video encoding apparatus performs the 
processing using the frame memories 107 for reordering which are 
originally installed in the apparatus, there is no increase in 
memories, and the control can be performed relatively easily. 
Further, since the video encoding apparatus of this first 
embodiment can be implemented by almost the same construction as 
the conventional encoder, sharing of circuits is realized, 
whereby an increase in costs is suppressed. 

While in this first embodiment four frames are employed, 
similar video encoding apparatus can be implemented even when the 
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number of frames is further increased. Further, similar control 
may be carried out not in frame units but in field units. 

Mo reover, the encode parameters to be used whe n encodin g is 

performed may be varied utilizing the time information. For 
example, when a difference from an ideal playback time is 
considerably large, it may be judged as a scene change, and the 
encoding order may be altered. 
[Embodiment 2] 

Hereinafter, a video encoding apparatus according to a 
second embodiment of the present invention will be described. 
The video encoding apparatus according to this second embodiment 
performs control for discarding the latest picture when picture 
input intervals are short, and the fundamental structure of the 
video encoding apparatus of this second embodiment is identical 
to that of the first embodiment except a part of the control flow 
shown in figure 3. Figure 6 is a block diagram illustrating the 
structure of the video encoding apparatus according to the second 
embodiment. In figure 6, reference numeral 105a denotes a 
controller. When no writable memory is found in the reordering 
memory 107, the controller 105a ends the processing without 
searching the data stored in the frame for one having the latest 
time and performing replacement of data. As a result, writing of 
new data into the reordering memory 107 is not carried out, and 
capture of data during this period of time is stopped. 

Hereinafter, a description will be given of the operation of 
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the controller 105a in the case where the frame sync signal 111 
is inputted, with reference to figure 7. 

The controller 105a captures the time i n formation 110 in 

STEP 601, and goes to STEP 602. 

In STEP 602, it is judged whether any of the input time 
information 220~223 is smaller than the threshold time 
information 210 or not. When none of the input time information 
22 0~223 is smaller than the threshold time information 210, the 
controller 105a goes to STEP 603. Otherwise, the controller 105a 
goes to STEP 604. 

When the controller 105a goes to STEP 604, since a writable 
frame memory exists, the frame memory number corresponding to the 
input time information that is smaller than the threshold time 
information 210 is outputted as a write frame number 112, whereby 
the video input enable signal is set in the enable state in STEP 
608, and recording of the input time is carried out in STEP 610 
to complete the processing. 

On the other hand, when the controller 105a goes to STEP 603, 
since data earlier than the threshold time information does not 
exist in the frame, it is judged whether any of the input time 
information 220~223 matches the reference picture time 
information 211 or not. When none of the input time information 
22 0~223 matches the reference picture time information 211, it 
means that no writable area (frame memory) exists. So, the 
controller 105a goes to STEP 609, and disables the video input to 
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complete the processing. On the other hand, when any of the 
input time information 220 — 223 matches the reference picture 

time i n formati on 211, the controller 105a goes to STEP 60 6. In 

STEP 606, it is judged whether the frame memory corresponding to 
the input time information that matches the reference picture 
time information 211 matches the encode frame number 114 or not. 
When the frame memory matches the encode frame number 114, it 
consequently means that no writable memory exists. So, the 
I s * controller 105a goes to STEP 609, and disables the video input to 

o 

O complete the processing. On the other hand, when the frame 
memory does not match the encode frame number 114, since a 
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writable memory exists, the controller 105a goes to STEP 611. In 
STEP 611, the controller 105a outputs the frame memory number 
corresponding to the input time information that matches the 
reference picture time information 211, as a write frame number 
112, and then goes to STEP 608. 

In STEP 608, the controller 105a sets the video input enable 
signal 113 in its enable state to enable writing, and goes to 
STEP 610. In STEP 610, the controller 105a writes the time 
information captured in STEP 601, into the area corresponding to 
the write frame number 112 among the input time information 22 0~ 
223, thereby completing the processing. 

As described above, the operation flow according to the 
second embodiment is almost identical to the flow which is 
described for the first embodiment with reference to figure 1, 
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but a remarkable difference exists in that the second embodiment 
does not perform the process of searching for data having the 
maximum time , which pr ocess corresponds to STEP 305 in figure 3. 

The use condition of the frame memory for the input frame 
according to the second embodiment will be described with 
reference to an operation timing chart shown in figure 8. 

As shown in figure 8, picture input is stopped during a 
period (a), and input of a picture "8" is not carried out. Other 
input operations are identical to those described with respect to 
figure 5. 

The eventual decoding result is shown in the final stage of 
figure 8. As compared with figure 5, a portion where a picture 
of time "8" is outputted in figure 5 is replaced with a picture 
of time "7" in figure 8. Also in this second embodiment, the 
decoding result is normally outputted. 

As described above, the video encoding apparatus according 
to the second embodiment is provided with the reference time 
generator 104 for generating a reference time, and the input 
picture data before being encoded and the time information 
generated by the reference time generator 104 are temporarily 
stored in the frame memories 107 for reordering, and the picture 
data stored in each frame memory is encoded according to the time 
information that is recorded simultaneously with the picture data. 
Therefore, even when vertical synchronization deviates, the data 
can be successively encoded according to the time information, 
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whereby the disordered input pictures can be encoded with less 
sense of abnormality. Further, when there is no area in the 
_ frame memor y where new data can be written, data input is stopped 
for one frame. Therefore, as compared with the first embodiment 
which performs the process of searching the data stored in the 
frame memory for one having the latest time and performing 
replacement of data, the judgement flow is reduced by an amount 
of this process, whereby the processing is simplified, leading to 

I* an increase in the processing speed. 

£3 ■ 

O Although the operation of the video encoding apparatus 

W according to the first embodiment when the sync intervals of 
fj| input data are short is different from that of the second 

embodiment, since these operations are almost identical from the 

viewpoint of control flow, a process of adaptively switching the 
j;0 above-described processes can be easily carried out. 

Hereinafter, a case where such switching is positively 

carried out will be described as a third embodiment of the 

present invention. 

[Embodiment 3] 

Figure 9 is a block diagram illustrating the structure of a 
frame rate conversion apparatus according to a third embodiment 
of the present invention. In figure 9, reference numeral 900 
denotes an encode frame rate which is supplied from the outside, 
and this encode frame rate 900 realizes an encoding cycle setting 
means. Reference numeral 901 denotes a controller which receives 
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the encode frame rate 900, and figure 10 is a block diagram 
illustrating the controller 901 in detail. In figure 10, 

refere nce numeral 1001 denotes an encode time gene r ator (encode 

time generation means) for obtaining an ideal input time when an 
encoding target frame is to be encoded. Other constituents are 
identical to those described for the first embodiment. 

Hereinafter, the operation of the frame rate conversion 
apparatus will be described. Since writing and reading of data 

H in/from the reordering memory 107 are identical to those already 

Vf described for the first and second embodiments, the frame rate 
conversion process will be mainly described in this third 

f jjj embodiment . 

" When a cycle T of an encode frame is decided by the encode 

Jj^ frame rate 900, the encode time generator 1001 included in the 
j2 controller 901 operates as follows. In the case where a 
^ reference picture is to be encoded, since an interval M of 
reference pictures is given, the encode time generator 1001 
generates a time which is obtained by adding a product of M and T 
to the time of the previous reference picture. 

Further, in the case where a "B" picture is to be encoded, 
when a picture which has been encoded one frame ahead is a 
reference picture, since a picture immediately after a forward 
reference picture is expected to be encoded, T is added to the 
encode time of the forward reference picture. Further, when a 
picture which has been encoded one frame ahead is a "B" picture, 
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since a picture at a time next to the "B" picture may be encoded, 
T is added to the time which has occurred one frame ahead. 

By performing th e above-mentioned processin g, enco di ng is _ 

carried out at a timing synchronized with the encode frame rate 
supplied from the outside, whereby a bit stream having a frame 
cycle which is completely different from the input frame cycle 
can be encoded. 

Figure 11 illustrates a timing chart in the case where 
encoding is carried out at a frame rate that is half the input 
frame rate. 

As can be seen from figure 11, a picture having a double 
frame rate can be generated by twice encoding the same frame. 

As described above, according to the third embodiment of the 
invention, the encode frame rate 900 is supplied from the outside, 
and an ideal input time of a target frame to be encoded is 
generated by the encode time generator 1001 included in the 
controller 901, and encoding is carried out in synchronization 
with the ideal input time. Therefore, encoding with a frame 
cycle which is completely different from the input frame cycle 
can be carried out, thereby controlling the frame rate at 
encoding . 



